Cognitive Constraints on the Use of Visible Speech and Gestures
نویسنده
چکیده
Gestures and visible speech cues are often available to listeners to aid their comprehension of the speaker’s meaning. However, visual communication cues are not always beneficial over-and-above the audible speech cues. My goal is to outline several types of constraints which operate in the human cognitive processing system that bear on this question: When do visual language cues (visible speech and gestures) provide an aid to comprehension, and when do they not? Research on visual-spoken language comprehension carried out in my lab over recent years is described and recommendations will be made concerning the design of multi-modal interfaces.
منابع مشابه
Mental Timeline in Persian Speakers’ Co-speech Gestures based on Lakoff and Johnson’s Conceptual Metaphor Theory
One of the introduced conceptual metaphors is the metaphor of "time as space". Time as an abstract concept is conceptualized by a concrete concept like space. This conceptualization of time is also reflected in co-speech gestures. In this research, we try to find out what dimension and direction the mental timeline has in co-speech gestures and under the influence of which one of the metaphoric...
متن کاملSome limits on encoding visible speech and gestures using a dichotic shadowing task.
Visible speech and gestures are two forms of available language information that can be used by listeners to help them understand the speaker's meaning. Previous research has shown that older adults are particularly dependent on visible speech, yet seem to profit less than younger adults from the speaker's gestures. To understand how visible speech and gestures are used when listening becomes d...
متن کاملGesturing Saves Cognitive Resources When Talking About Nonpresent Objects
In numerous experimental contexts, gesturing has been shown to lighten a speaker's cognitive load. However, in all of these experimental paradigms, the gestures have been directed to items in the "here-and-now." This study attempts to generalize gesture's ability to lighten cognitive load. We demonstrate here that gesturing continues to confer cognitive benefits when speakers talk about objects...
متن کاملVisual Context Enhanced: The Joint Contribution of Iconic Gestures and Visible Speech to Degraded Speech Comprehension.
Purpose This study investigated whether and to what extent iconic co-speech gestures contribute to information from visible speech to enhance degraded speech comprehension at different levels of noise-vocoding. Previous studies of the contributions of these 2 visual articulators to speech comprehension have only been performed separately. Method Twenty participants watched videos of an actres...
متن کاملDisfluency production in speech and gesture
The cognitive architecture and function of co-speech gesture has been the subject of a large body of research. We investigate two main questions in this field, namely, whether language and gesture are the same or two inter-related systems, and whether gestures help resolve speech problems, by examining the relationship between gesture and disfluency in neurotypical speakers. Our results support...
متن کامل